Cascade-Correlation Algorithm with Trainable Activation Functions
نویسندگان
چکیده
منابع مشابه
Cascade-Correlation Algorithm with Trainable Activation Functions
According to the characteristic that higher order derivatives of some base functions can be expressed by primitive functions and lower order derivatives, cascade-correlation algorithm with tunable activation functions is proposed in this paper. The base functions and its higher order derivatives are used to construct the tunable activation functions in cascade-correlation algorithm. The paralle...
متن کاملExperiments with the Cascade-Correlation Algorithm
1 2 3 This paper describes a series of experiments with the cascade-correlation algorithm (CCA) and some of its variants on a number of real-world pattern classi cation tasks. Some of these experiments investigate the e ect of di erent design parameters on the performance of CCA (in terms of number of training epochs and classi cation accuracy on the test data). Parameter settings that consiste...
متن کاملRecurrent neural networks with trainable amplitude of activation functions
An adaptive amplitude real time recurrent learning (AARTRL) algorithm for fully connected recurrent neural networks (RNNs) employed as nonlinear adaptive filters is proposed. Such an algorithm is beneficial when dealing with signals that have rich and unknown dynamical characteristics. Following the approach from, three different cases for the algorithm are considered; a common adaptive amplitu...
متن کاملA Genetic Cascade-Correlation Learning Algorithm∗
Gradient descent techniques such as back propagation have been used effectively to train neural network connection weights; however, in some applications gradient information may not be available. Biologically inspired genetic algorithms provide an alternative. Unfortunately, early attempts to use genetic algorithms to train connection weights demonstrated that exchanging genetic material betwe...
متن کاملLearning with limited numerical precision using the cascade-correlation algorithm
A key question in the design of specialized hardware for simulation of neural networks is whether fixed-point arithmetic of limited numerical precision can be used with existing learning algorithms. An empirical study of the effects of limited precision in cascade-correlation networks on three different learning problems is presented. It is shown that learning can fail abruptly as the precision...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computer and Information Science
سال: 2011
ISSN: 1913-8997,1913-8989
DOI: 10.5539/cis.v4n6p28